EmbodiComp: Embodied Interaction for Mixing and Composition

We introduce EmbodiComp, a novel system that leverages simple and common gestures to allow for simultaneous mixing and composition. Through the use of a “band performance” metaphor that offers users the illusion of being part of an ensemble, musicians are able to play and mix their instruments with pre-recorded tracks in real-time through embodied interactions. Using five unique features, our system allows musicians to experiment seamlessly with volume and reverb levels, as well as the degree to which instruments are mixed, as they simply move about their space. As such, users can easily explore various settings and arrangements during composition, and determine how an instrument might best fit with others in the final piece. The system evolved, in part, as a result of a collaboration between an engineer and a composer that is also described in this paper. The outcomes of this participatory design cycle indicate that EmbodiComp could prove beneficial for musicians seeking to facilitate the process of composition through alternatives to traditional mixing tools.